SPEC
Welcome to SPEC
A global leader in trusted standards for performance and analysis.

The Standard Performance Evaluation Corporation (SPEC) a non-profit corporation, establishes and maintains standardized, vendor-agnostic benchmarks and tools to evaluate performance and energy efficiency for the newest generations of computing systems.

The State of AI/ML Benchmarking: Addressing Gaps and Driving Progress

In the rapidly evolving field of artificial intelligence (AI) and machine learning (ML), enhancing the accuracy and computational efficiency of large models remains a critical challenge. As of 2024, there are over 100 commercial large language models worldwide, with OpenAI’s ChatGPT boasting more than 500 million users. The swift development of these models is driving significant advances in AI capabilities.

SPECworkstation 4.0 Benchmark Measures Latest Workstation Hardware, Adds AI/ML Workloads

I’m extremely excited that SPEC has announced the release of the SPECworkstation 4.0 benchmark, a major update to SPEC’s comprehensive tool designed to measure all key aspects of workstation performance. This significant upgrade from version 3.1 incorporates cutting-edge features to keep pace with the latest workstation hardware and the evolving demands of professional applications, including the increasing reliance on AI and machine learning (ML).

The Latest News from the SPEC Embedded Group

The first edition of the EG Newsletter is out, giving us a regular opportunity to update the community on everythign happening with SPEC’s Embedded Group.

The SPECvirt® Datacenter 2021 Benchmark — An Answer to the Datacenter Architect’s Dilemma

An IT architect designing a virtualization-focused data center faces a variety of crucial choices.

Wrapping Up ICPE 2024: A Milestone Event in Performance Engineering

We are delighted to share insights and highlights from the recently concluded 15th annual ACM/SPEC International Conference on Performance Engineering (ICPE) 2024, held May 7-11th in the historic and vibrant city of London. ICPE has been the flagship conference in the area of performance engineering over the years and has a tradition of bringing together both academic scholars and industrial practitioners in discussing the recent advances in the area.

The SPECworkstation 3.1 Benchmark — A User's Story

Nikki is a procurement manager at a large digital media and marketing company that offers vertical solutions for a range of industries, including media and entertainment, life sciences and ecommerce. She was tasked with purchasing over 300 new workstations to satisfy the needs of power users across the company – while staying within a finite budget.